Papers with semantic-free paradigm
The Illusion of Randomness: How LLMs Fail to Emulate Stochastic Decision-Making in Rock-Paper-Scissors Games? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research indicates that large language models articulate the theoretical probability distributions associated with optimal strategic choices, but their actual decision-making diverges from these prescriptions. |
| Approach: | a systematic evaluation of 20 state-of-the-art LLMs reveals a cognitive bias gap . intrinsic biases inherited from pre-training corpora alone are insufficient to explain deviations . a semantic-free paradigm strips away intrinsic bias to isolate pure positional bias . |
| Outcome: | a systematic evaluation of 20 state-of-the-art LLMs shows that intrinsic biases are insufficient to explain deviations. |